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NEURAL NETWORK 



This invention relates to a neural network. Examples of 
the invention are described in the attached papers A, B 
5 and C. 



A Novel Hybrid Neural Network for Identification of Trace Compounds 



Soonil D. Rughooputh* and Harry C. S. Rughooputh** 
University of Mauritius, Reduit, Mauritius 
*sdr@dove.uorn.ac.rnu, *^rputh@dove.uom.ac.rnu 



Abstract 

Trace compound identification forms an important 
clement of forensic science. Innovative instrumental 
designs based on Raman spectroscopy have made 
possible its in-siiu use" oh fingerprint samples. 
Recently, the Pulse-Coupled Neural Network (PCNN), 
an oscillatory model neural network, has been used for 
invariant feature extraction for object recognition and 
classification. In this paper, we propose a novel hybrid 
neural network model for quick identification of trace 
materials from their Raman images. This network 
consists of a PCNN pro-processor. The features 
(icons) generated by the PCNN are then fed into a 
feedforward neural network for classification. 



1. Introduction 

Identification of prohibited trace compounds remains 
essentially the job of expert spcctro9copists. Raman 
spectroscopy proves to be a versatile technique for 
analyzing and identifying such materials. It is fast, 
requiring little sample preparation time whilst being a 
non-dcstructxvo technique. Identification of trace 
compounds can be a cumbersome job since it implies 
cross-checking within a large database of Raman 
spectral bands and, more so, given the possibility that 
these moy be present as mixtures. 

Photons interact inclasticaily with atomic vibrations 
(phdnons) to produce Raman scattered light. A given 
molecule will have a characteristic Raman spectrum - a 
unique fingerprint of a material. The whole Raman 
spectrum therefore contains information about the 
structure of the molecule and its environment. The 
amount of material required for Raman work can be as 
low as 1 picogram in mass. This has been recently 
demonstrated using the Renishaw Raman microscope 
11 J, developed at Leeds. This innovative design has 



enabled its in-siiu use for imaging on fingerprint 
samples. The instrument has also been tested remotely 
using fibre optics with a view to develop portable 
Raman systems [2]. 

Neural networks arc increasingly.'betng used in several 
applications. There has been considerable interest in 
their use for pattern recognition. Recently, studies of 
the visual cortex of the cat highlight the role of 
temporal processing using synchronous oscillations for 
object identification [3]. This has led to a Pulsed- 
Coupled Neural Network (PCNN) wherein dendritic 
processing is incorporated through the use of 
multiplicative modulation along with a linking 
mechanism. This biologically inspired network is very 
well suited for image/signal pre-processing (4}. 

In this paper, a novel technique, involving a hybrid of 
a PCNN and a classical MLP feedforward network, is 
described for the purpose of quick identification f 
chemical compounds in trace amounts. Raman 
spectra] images of these trace compounds are presented 
to the PCNN pre-processing unit to obtain outputs that 
are assembled into time signatures (or icons) of the 
specimon. The Multi Layer Pcrccptron (MLP) 
classifier is then trained by using a database of such 
icons. Preliminary results suggest this hybrid network 
has a great potential for the recognition of materials 
present in minute amounts. 



2. The Hybrid Neural Network 

An MLP classifier can be constructed directly from 
Raman spectra for the present objective. However, 
this will require a very large MLP with hundreds of 
input neurons. In our proposed method we use a 
hybrid neural network. This network consists of two 
sections: 



(a) a pre-processing PCNN that produces the Raman 
images' signatures* and 

(b) o p st-pr ceasing neural network (a classical 
MLP) that will recognize the signature. 

The PCNN, Figure 1, has received much attention 
from the image processing community. It comprises of 
a two-dimensional integrate and fire neurous with one 
neuron for each input pixel. The PCNN neuron 
consists of three ports: 

(1) Tho input unit (dendritic tree) includes the image 
pixel input (real value) as well as feedback 
(binary) inputs from surrounding neurons. 

(2) The linking and feeding branches merged together 
to compute the internal activation U. The 
integrated signals from the linking synapse plus au 
orTset term of T are multiplied with the 
integrating signals from the feeding synapse to 
produce a membrane voltage U. 

(3) The pulse generator, compares the threshold value 
0 and U. If U>0, then the PCNN output becomes 
equal to 1 and is reset to a maximum value V e< 
else the output is zero and 0 is decreased 
exponentially by tho time constant a©. 

The PCNN can be implemented by iterating the 
following equations: 



F 0 [n] 



xp(-a r )F g [n-l]- 



v 

Mom Y u [n-1] (]) 
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otherwise 
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(4) 
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where S is the stimulus input (the pixel intensity), V 
and L arc the feeding and linking inputs to the neuron 
ond Y is the output The other parameters include tliree 
potcniiuls. V, and three decay constant* a, associated 
with F, L and ©> respectively; 0 being the linking 
scaling constant. "Hie interconnections in M and W arc 
local Guussians (dependent on the distance between 
the neurons). 



If a digital image is applied as input, to such a PCNN 
network, the network groups image pixels based on 
spatial proximity and brightness similarity, Kuntimad 
[5], A tw -dimensional input function can be mapped 
into a ne-dimensional output function for e.g. time- 
scries. Spatial averaging of neural responses gives a 
temporal output signal that is shown to be valid as a, 
coding mechanism. The time signal Q[nJ, as computed 
by equation (6). is the number of "on pixels'* in each 
iteration. 



u 
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Since the PCNN provides a one-to-one correspondence 
between images and their time signatures (icons), it is 
opportune to exploit this property in this paper to 
create a database of another set of fingerprints from 
Raman spectra of trace compounds. 

The PCNN unit, described ab'ove is only a pre- 
processor and requires some task specific post- 
processing. In this work, the post-processing is carried 
out by a backpropagation neural network since the 
objective is to classify, and subsequently, to identify 
different trace compounds. A database of the icons of 
the trace compounds is used for the training/testing f 
the neural network classifier. The icons generated by 
using the PCNN from the Raman spectrum of any 
material in the database can then be matched by the 
MLP classifier with the corresponding signature within 
the large database for identification. 



3. Results 

The method described above is used for the 
identification of a few trace compounds: Pcnta 
erythritol tetranitrate (PETN), dimethyl dinitroburanc 
(DMNB), 2,4,6-Trinitro toluene (TNT), , 4- 
mbnoniirotolucne . (4MNT), 3 ,4-dinicro toluene 
(34DNT), heroin, and cocaine [6, 7). Typical Raman 
spectra of those materials excited at ca. 244 nm and 
633 nm with chemical structures also shown in the 
Figures 2 and 3 respectively. 

A large number of iterations is required for each 
Raman image before a cyclic panern becomes 
discernible in the time signature. Thus, a sampled lime 
signature is employed to cover a representative portion 
of the cycle (100 iterations). Different time signatures 
were obtained for each Raman image for 16 different 
sets of PCNN parameters (a's, 0 and V*s). 

For excitation at 244nm/G*33 nm, 80/55 signatures were 
used to train the feed forward neural network with the 



-following architecture: 3 t neurons, 10 hidden 
neurons and 3 output neurons. Each training data 
consists of gated PCNN time signature amplitudes and 
the output data (in the required output format 
corresponding to the compound). The remaining 
signatures (32/25) were used t test the MLP. 

Our test results indicate a high success rate (>98.3%) 
for the identification. 



4. Conclusions 

One-dim ens ional time signatures (icons) were obtained 
from Raman images- (two-dimensional) of selected 
trace compounds by using a PCNN pre-processor. 
These icons arc used as a fingerprint database for these 
materials to train a Multi Layer Perceptron classifier. 
: Thc icon corresponding- to (he Roman image - of a « 
particular compound could then identified (with high 
success rate). 

Thus, the identification process using neural network 
avoids the consultation of huge listings of the Raman 
bands/Raman peak intensities altogether - saving time. 
It also saves the institution from an in-depth training 
on Raman spectroscopy of these materials. The 
identification can thus be performed by non-experts. 
Our preliminary results in this work demonstrate the 
cflccrJ venesa of the hybrid neural network, and hence, 
its potential for use in other similar areas. 

Our investigations are being extended to include a 
larger number of chemicals, mixtures of chemicals, 
and to study the effect of noise and fluorescence or 
scattering background inherent in Raman images. 
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Spectral recogrflKn using a modified Eckhorn flfral network model 

H.C.S. Rughooputh and S.D.D.V. Rughooputh 

Indexing terms: Image processing, neural networks, spectralrecognition - , 

Studies of the visual cortex of the cat highlight the role of temporal processing using synchronous 
oscillations for object identification. In this paper, the original neural network model of Eckhorn lias 
been modified according to die proposal of Johnson and others and used for spectral recognition. 
The y method developed turns out to be a much simpler, faster and elegant way of spectral 
recognition than reported elsewhere: 



There has been considerable developments in the use Artificial Neural Networks to, solve 
object recognition tasks. Based on the recent experimental findings of the visual cortex of 
the cat, there is evidence of synchronised neural activity in the brain and that temporal 
correlation of firing of neural assemblies could serve as a general coding mechanism for 
feature binding and pattern segmentation [1]. This has led to a computer-modelled cortex 
(pulsed coupled) neural network (PCNN) (Figure 1) [2] wherein dendritic processing is 
incorporated through the use of multiplicative modulation along with a linking mechanism. 
This biologically inspired network is very well suited for image/signal pre-processing. 

Recently a one-dimensional PCNN has been used as a peak segmenter for spectral peak 
finding [3]. However, the method utilised is complicated (involving tens of thousands of 
iterations) and may not always yield satisfactory result. We develop here, using a similar 
neural network, a much simpler and elegant way of spectral recognition. The recognition 
involves first the conversion of spectral images into binary barcode-like images followed 
by an identification step. We present in this work a few examples where the recognition 
has been used for t he identifica t ion of materials, fo i diagnostic purposes and fo r condition — 
monitoring of electrical machines. We focus on identifying chemicals such as narcotics 



"1 & 

and explosive^pTi their Raman spectra, on diagnos^J^ for heart condition fl ^^^^ 
signals and on condition monitoring of power transformers. We demonstrate that our 
approach is fast and robust and suits real-time tracking applications. 

The PCNN offers tremendous advantages. It has the inherent ability to extract the 
fundamentals of the image and it simplifies the image to allow recognition engines to 
perform far easier task than is within their realm, If^ digital image is applied as input to 
such a network, the network groups image pixels based on spatial proximity and brightness 
similarity, Kuntimad [4]. The network comprises of a two-dimensional array of integrate- 
and-fire neurons with one neuron for each input pixel. Each neuron receives input signal^^ 
from a feeding synapse and a linking synapse. The former gets its inputs from other 
neurons whilst the linking synapse obtains its inputs from lateral and feedback 
connections, both synapses inducing decaying potentials. The integrated signals from the 
linking synapse plus an offset term of T are multiplied with the integrating signals from 
the feeding synapse to produce a membrane voltage that is compared to a local dynamic 
threshold. When this membrane potential, exceeds the value of the dynamic threshold, the 
neuron fires to produce an output spike; consequently, the threshold is significantly 
increased. This value then decays until the neuron fires again. 

... • 

The PCNN does not require any training or adjustment to extract the image fundamentals 
from the diverse set of imagery. Edges and segments are extracted at different iterations 
and segments can easily be seen over the course of a few iterations. Segment extraction 
occurs since groups of neurons in a similar state tend to pulse in unison. Edges are 
extracted as the autowave expands from these segments. In the original form, the PCNN 
neurons will lose the unison pulsing according to the texture of the input. So, in time, the 
segments will tend to separate according to the texture. Thus, the most important aspect of 
th e PCNN performing these extractions is that it is an inherent quality of th* ECNN 
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Furthermore, th|j^NN provides a higher quality of t^J^ 

rmance and easy recognition 

(accomplished with the iterated 'binary' images). The full mathematical description of the 
PCNN can be obtained elsewhere [5], 

We demonstrate our novel method on three different applications: (a) identification of 
trace compounds from their Raman spectra, (b) monitoring of cardiac cycle (ECG 
tracings), arid (c) condition monitoring of power transformer from its transfer function 
spectra. Individual input spectra, in the form of gray level images, are presented to the 
PCNN. As an example, we show in Figure 2, the Raman spectrum of an explosive (trace 
compound), dimethyl dinitrobutane (DMNB), the corresponding 8-bit gray level image 
and the binary images produced by the PCNN after iterations 1, 2, 7 and 8. Figure 3 
shows the; 8-bit gray level images and the binary images produced by the PCNN after 
iterations 1 and 7 for two trace compounds, ECG tracings and phase spectra of power 
transformers. There is a one-to-one correspondence between the barcode-like PCNN 
output and the corresponding input image. This feature is exploited in our spectral 
recognition technique. These barcodes can be used either singly (one iteration only) or in 
combination (more than one iteration) as explained below. 

The first iteration PCNN output is converted into a binary codeword and stored in a look- 
up table (LUT). For the spectral recognition, the codeword is obtained from the 
corresponding spectrum and its Hamming's distances from all the codewords in the LUT 
are computed. The spectrum corresponding to the least Hamming distance gives the 
identity of the input. Ties in minimum Hamming distance are resolved by repeating the 
procedure using codewords generated from other PCNN iterations. In our present work, 
ties did not occur and the recognition rate success was 1 00%. 



In summary, \|^ive presented a very fast and robt^^iethod for spectral re Jf^Jh. 
The PCNN provides a higher quality of performance with easier recognition using the 
iterated 'binary 5 images than other techniques. Our test results obtained using the neural 
network demonstrate that the approach is fast and robust making it suitable for real-time 
tracking applications in a wide variety of fields. 
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Figure 1: The PCNN pre-processor - a schematic representation 



Figure 2: Bottom: Raman Spectrum of DMNB excited at 633 nm, 

Top (from left to right): Gray level image of DMNB and PCNN outputs 
(iterations 1, 2, 7 and 8). 



Figure 3: From top to bottom (see text): 

Raman spectra of DMNB and Cocaine; ECG tracings of a normal heart 
and one with atrial fibrillation; Phase Spectra showing effect of short 
circuits : no shorted turns, 2 turns on high voltage winding shorted, and 2 
turns on adjacent windings shorted. 



Biologically-inspired hybrid neural network for spectral 
identification, condition monitoring and diagnosis 

S.D.D.V. Rughooputh and H.C.S. Rughooputh 
University of Mauritius, Reduit, Mauritius 

Recent experimental findings of the visual cortex 1 of the cat have shown evidence of 
synchronised neural activity in the brain, thus suggesting that temporal correlation of 
firing of neural assemblies could serve as a general coding mechanism for feature £ 
binding and pattern segmentation. This has led to a computer-modelled cortex (pulsed 
coupled) neural network 2 (PCNN) wherein dendritic processing is incorporated through 
the use of multiplicative modulation along with a linking mechanism. Since then, there 
has been considerable interest in the use of spike producing neurons to solve object 
recognition tasks in many fields 3 * 5 . This biologically inspired network is very well suited 
for image/signal pre-processing. In this paper, the original neural network model of 
Eckhorn 1 has been modified according to the proposal of Johnson 2 and used for spectral 
recognition of materials and objects, for condition monitoring of machines and for 
medical diagnosis. Applications thus range from chemistry, medical and forensic 
sciences, engineering to astrophysics. The method developed turns out to be much 
simpler, faster and more robust than methods reported in literature and it is also 
suitable for real-time applications in many fields. 

Traditional image processing is generally based on a limited set of fundamental operations 
such as convolution of matrices: For most applications, only a few image features (e.g. 
textures, edges and segments) are important. The traditional method of recognising objects 




within an image is through the use of a Fourier filter that works by matching the frequencies 
of the target with those of the input image. This Fourier filter system as well as others (e.g. 
neural networks, morphology, and statistical image processing) have been shown to have a 
number of serious drawbacks when it comes to real world applications. 

The PCNN offers tremendous advantages: It has the inherent ability to extract the 
fundamentals of the image and it simplifies the image to allow recognition engines to perform 
far easier task than is within their realm. If a digital image is applied as input to such a 
network, the network groups image pixels based on spatial proximity and brightness 
similarity 6 . The network, shown in Figure 1, comprises of a two-dimensional array of 
integrate-and-fire neurons with one neuron for each input pixel. Each neuron receives input 
signals from a feeding synapse and a linking synapse. The former gets its inputs from other 
neurons whilst the linking synapse obtains its inputs from lateral and feedback connections, 
both synapses inducing decaying potentials. The integrated signals from the linking synapse 
plus an offset term of ' 1 ' are multiplied with the integrating signals from the feeding synapse 
to produce a membrane voltage that is compared to a local dynamic threshold. When this 
membrane potential exceeds the value of the dynamic threshold, the neuron fires to produce 
an output spike; consequently, the threshold is significantly increased. This value then 
decays until the neuron fires again. The full mathematical description of the PCNN can be 
obtained elsewhere 5 . 

The PCNN does not require any training or adjustment to extract the image fundamentals 
from the diverse set of imagery. Edges and segments are extracted at different iterations and 
segments can easily be seen over the course of a few iterations. Segment extraction occurs 
since groups of neurons in a similar state tend to pulse in unison. Edges are extracted as the 



autowave expands from these segments. In the original form the PCNN neurons will lose the 
unison pulsing according to the texture of the input. So, in time, the segments will tend to 
separate according to the texture Besides, the PCNN provides a good performance and easy 
recognition (accomplished with the iterated 'binary' images rather than the original input) 7 . 

Recently, a one-dimensional PCNN has been used as a peak segmenter for spectral peak 
finding 8 . However, the method utilised is complicated (involving tens of thousands of 
iterations) and may not always yield satisfactory result. Of the various , methods reported so 
far for the suggested applications, none give truly convincing results. We present here a 
much simpler and elegant way for conducting these tasks using a similar neural network 
preprocessor. The recognition involves the conversion of spectral images (in their grey level 
format) into binary barcode-like images by the PCNN preprocessor. This is followed by an 
identification step., 

We demonstrate our novel technique on a few examples embracing different applications: 

(a) condition monitoring of power transformer from its transfer function spectra, 

(b) identification of chemical compounds from their infrared spectra, 

(c) identification of trace compounds (narcotics and explosives) from their Raman spectra, 

(d) monitoring of cardiac cycle, and 

(e) identification of pulsar profiles. 

Individual input spectra in the form of 8-bit grey level images (Figure 2) are presented to the 
PCNN. In Figure 3, we show the corresponding binary images produced by the PCNN after 
iterations 1 and 7. There is a one-to-one correspondence between these barcode-like PCNN 
outputs and the corresponding input images. This feature is exploited for our 
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recognition/diagnosis/monitoring tasks. We note that these binary barcodes can be used either 
singly (one iteration only) or in combination (more than one iteration). 

In a preliminary study 9 , we reported the use of a look-up table (LUT) for recognition. In the 
current study, we make use of a much faster technique for recognition using n-tuple (RAM) 
based neural network 10 instead of the LUT. The memory-based architecture of RAM-based 
neural networks provides many important features including one-shot learning and fast recall 
times. The* architecture is basically a number of LUTs in parallel where each LUT is 
analogous to the weight matrix of a feedforward neural network. The speed and success fate 
for recognition are very encouraging. 

Our technique involving the hybrid neural network' (PCNN preprocessor and n-tiiple RAM- 
based neural network) has successfully been used for the purpose of recognition, diagnosis 
and condition monitoring tasks. It provides a better performance with easier recognition than 
any other existing techniques. Our test results demonstrate that the approach is fast arid 
robust making it suitable for real-time applications. 
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FIGURE CAPTIONS 



Figure 1: The PCNN pre-prdcessor - a schematic representation 
Figure 2: 8-bit grey level input images of (from left to right) 

(a) Transfer function spectra of power transformer showing effect of short circuits 
no shorts; 2 turns on HV windings shorted; 2 turns on adjacent windings shorted 

(b) Infrared spectra of chemical compounds 

Cyclohexanone; Acetate fibre Avtex code 6941; Poly(isobutyl methacrylate) 

(c) Raman spectra of trace compounds: 
Heroin and Tri Nitro Toluene (TNT) 

(d) ECG tracings of human heart 

Heart with A trial Fibrillation and Normal Heart 

(e) Intergrated Pulsar profiles 
1426-66 and 1133+16 

Figure 3: Corresponding Binary PCNN image pairs (iterations 1 and 7) of spectra 
from Figure 2 - from top to bottom. 




l 7- • - 



4000 
•J500 

3oco r- 

2500 C 
2(XX) 
1500 
1000 
500 
0 



1 




700 
600 
500 j- 
400 
300 
200 
100 
n 

1200 
I (XX) 

H00 

600 

400 



500 .. 1000 1501) 2000 ,2500 3000 3500 

- ' » 1 ' 1 1 \ 1 1 1 1 'i ■ 



.1 

1 



>—* . . — m* , « T -J - — • 

■ ■ t •■ ■ . . 1 . x j, ....IT 




ir^i, 



500 1000 1500 2000 2500 3000 3500 
Raman i lull /em* 1 



KlCIIMl' 2: Kji-un S|*r\tn tti'.NwrcvItct A KipUiwvws i wiled at 241 Mm 




'~W~~ < 



'1 




4000 -~ ll I ll 

2000 sJuJM— JLAJ vj^ 




500 1000 1500 2000 2500 3000 3500 
Raman shift / cm' 1 



KII.'UUK y. lUnuw Sprrln of No raids A tlcpJu&ivcs riallcd »i W mu 




500 1000 1500 2000 2500 3000 3500 
Ramar'shifi/cm'' " 



Figure 2: Bottom: Raman Spectrum of DMN3 excited at 533 nm. 

T op (from left to right): Gray level image of DMNB and PCNN outpu 
(iterations 1, 2, 7 and 8). 
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figure 3: From top to bottom (see text): 

Rrr.M spectra of DMNB and Caciine; ECO tracing? of a normal hear, 
and one wilrt atrial fibrillation; Phwe Spectra xhowing effect of short 
circuit* : no shorted turns, 2 '.urns on high vol tage winding shorted, and \ 
tuns on adjacent winding! shorted. V 
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